Running Head: COMBINING META-ANALYSIS AND REPLICATION In Press, Advances in Methods and Practices in Psychological Science (AMPPS) A simple, principled approach to combining evidence from meta-analysis and high- quality replications

Recent discussions of the influence of publication bias and questionable research practices on psychological science have increased researchers’ interest in both biascorrecting meta-analytic techniques and preregistered replication. Both approaches have their strengths: For example, meta-analyses can quantitatively characterize the full body of work being done in the field of interest and preregistered replications can be immune to bias. Both approaches also have clear weaknesses: Decisions about which meta-analytic estimates to interpret tend to be controversial and replications can be discounted for failing to fulfill key boundary conditions that are specified by theory to produce an effect. Using the experimental literature on the ego depletion phenomenon as a case study, we illustrate a principled approach to combining information from metaanalysis with subsequently conducted bias-free replications. This approach (1) compels researchers to explicate their beliefs in meta-analytic conclusions (and also, when controversy arises, to defend their warrants for embracing those beliefs), (2) encourages consideration of practical significance, and (3) facilitates the process of planning replications by specifying the sample sizes necessary to have a reasonable chance of changing the minds of other researchers.